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DETAILED ACTION 

1 . This Office Action is regarding Applicant's response filed 30 November 
2009 to a prior Office Action. Claims 22 - 33 are pending. Claims 22 and 27 are 
amended. 

2. This Office Action is the Sixth Action, Final Rejection. 

Information Disclosure Statement 

3. The Examiner has considered the Information Disclosure Statement filed 
10 March 2010. A copy of the annotated IDS is enclosed with this Office Action. 

Response to Arguments 

Claim Objections 

4. The Examiner has noted the corrections to claims 22 and 27. Thus the 
objection to these claims is withdrawn . 

35 USC § 103(a) 

5. Applicant's arguments (page 7-11) and amendments, filed 30 November 
2009, regarding the rejection under 35 USC § 103(a) of claims 22 - 33 have 
been fully considered but are not persuasive. 

Applicant argues that as the claim has been amended to require that a 
query is required exist in the template, the claim overcomes the prior art of record 
(more specifically Sweat et al.). First, the Examiner maintains that Sweat et al. 
uses a template system for generation of media modules and objects (See col 4, 
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lines 31 - 40). The Examiner further notes that whether a palette has a "query" 
does not determine its status as a template. A template, in the context of this 
invention, is a module or object that accepts and integrates other modules or 
objects. Thus, the palette of Sweat et al. meets this contextual definition. As to 
whether the palette of Sweat et al. contains a "query", the Examiner submits that 
the palette contains media modules. These media modules have a number of 
buffers including a connections buffer (i.e. stores links, see col 4, lines 59 - 67 
and col 5, lines 1 - 2, this is relationship data). In Reber et al {[col 11, lines 39 - 
41]), this linking can be provided as a dynamically generated system using a 
query. Thus, the Examiner submits that the combination of these references 
provides both the template and the query inside the template. 

As for Applicant arguments regarding the "related media object identity 
data" and "relationship data", the Examiner submits that neither of these data 
elements are explicitly used by the analyzing step. However, the Sweat et al. 
teaches related media object data and relationship data (see col 4, lines 59 - 67 
and col 5, lines 1 - 2). Reber et al. teaches a table of relations between media 
objects (see Figure 2) and thus must teach the identity of each of the related 
object as well (otherwise the data is completely useless). Thus, even though 
these two elements do not affect the scope of the claimed invention, they are 
taught by Reber et al. and Sweat et al. 

For these reasons, the rejection under 35 USC § 103(a) of claims 22 - 33 
is maintained . 
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Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth in section 102 of this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

7. This application currently names joint inventors. In considering 
patentability of the claims under 35 U.S.C. 103(a), the examiner presumes that 
the subject matter of the various claims was commonly owned at the time any 
inventions covered therein were made absent any evidence to the contrary. 
Applicant is advised of the obligation under 37 CFR 1 .56 to point out the inventor 
and invention dates of each claim that was not commonly owned at the time a 
later invention was made in order for the examiner to consider the applicability of 
35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) prior art under 35 
U.S.C. 103(a). 

8. Claims 22 - 33 are rejected under 35 U.S.C. 1 03(a) as being unpatentable 
over Reber et al (US Patent 5,584,006; patented 10 December 1996) in view of 
Sweat et al (US Patent 5,619,636; patented 8 April 1997). 

9. In regard to claim 22, Reber et al teaches a method of automatically 
composing a media article, the method comprising: 

iteratively finding each section and executing any query in that section to 
return a selection of media objects each of which is associated with a 
corresponding media element and comprises digital metadata about its 
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respective media element ([col 11, lines 39 - 41] the table of relations is 
analyzed by the application continuously to find equivalent media data, i.e. media 
data that can be part of the same time sequence from the same or different 
sources and arranges media data by changing sources as well as adding 
additional pieces of media data in accordance to the results of the analysis); and 
analyzing the digital metadata of the selected media objects, which digital 
metadata ([col 3, lines 52 - 54], the table of relations links the linear media data 
and any digitized media data) includes: 

related media object identity data identifying a related media object, 
the media object containing the related media object identity data and the 
related media object being referred to as related media objects, and 
relationship data which indicates the type of relationship between what is 
represented by the respective media elements corresponding to the 
related media objects (a table of relations between media objects, see 
Figure 2 and thus must teach the identity of each of the related object as 
well (otherwise the data is completely useless)); 
wherein the method further comprises, arranging the media elements 
associated with the selected media objects, or identifiers thereof, in a media 
article in dependence upon the type of relationship of the related media objects 
forming some or all of the selected media, or identifiers thereof, as determined by 
the metadata analysis ([col 11, lines 39 - 41] the table of relations is analyzed by 
the application continuously to find equivalent media data, i.e. media data that 
can be part of the same time sequence from the same or different sources and 
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arranges media data by changing sources as well as adding additional pieces of 
media data in accordance to the results of the analysis). 

Sweat et al further teaches said one or more media element selection 
criteria comprise a set of template data, each of said sets of template data listing 
a plurality of slots to be filled ([col 7, lines 1 2-1 8] palette is a template with a 
number of slots), and, for each slot, one or more associated requirements of 
media elements for filling said slot ([col 7, lines 12-18] user query sets criteria for 
filling the slot on the palette); and said one or more processors are further 
arranged in operation to provide said subset by, for each of said slots, retrieving 
one or more identifiers of media elements whose metadata accords with said one 
or more requirements for said slots ([col 7, lines 12-18] fully constructed palette 
can be saved and used). It would have been obvious to a person of ordinary skill 
in the art at the time of invention to use an object-oriented database of Sweat et 
al with the apparatus of Reber et al because it would allow for greater 
compatibility, modularity and easy of use for a user. 

10. In regard to claim 23, Reber et al teaches a method according to claim 22 
further comprising generating said related media object identity data and said 
relationship data ([col 10, lines 36 - 38] relational information pertinent to the list 
of source identifiers is added to a list of relational information i.e. generating 
relationship data, [col 10, lines 46-47] any new source identifiers are added to the 
source list i.e. generating identity data). 

11. In regard to claim 24, Reber et al teaches a method according to claim 22 
wherein said metadata of each media object further comprises content data 
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indicating what is represented by the media object's corresponding media 
element ([col 11, lines 5 - 7]; a time sequence that media data covers is stored in 
the table of relations as is shows equivalence), and 

wherein said step of iteratively finding and executing queries comprises 
selecting, from a plurality of media elements, one or more media elements in 
dependence upon said content data ([col 11, 34-38 and col 11, lines 43 - 47]; the 
application selections from set of media data the available and most complete 
media data based on the time sequence data). 

12. In regard to claim 25, Reber et al teaches a method according to claim 22 
wherein said arranging step arranges said media elements so as to determine 
the order in which the user sees or hears what is represented by the selected 
media elements ([col 11, lines 41 - 49] the relationship between the two sets of 
media data is the equivalence of the media data including data on how the 
equivalent media overlap, what sequences overlap and their locations stored in 
the table of relationships; [col 11,42- 43] application arranges the media data in 
a time sequence and switches in and out media on the fly to keep what a user 
sees and hears in sequence). 

13. In regard to claim 26, Reber et al. teaches a method according to claim 
22 in which said media elements contain video data ([col 1, lines 17-19]). 

14. In regard to claim 27, Reber et al. teaches a media article composition 
apparatus comprising: 

one or more memory devices storing, for each of a plurality of media 
elements, metadata including: 
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related media object identity data identifying a related media object, 
the media object containing the related media object identity data and the 
related media object being referred to as related media objects, and 
relationship data which indicates the type of relationship between what is 
represented by the respective media elements corresponding to the 
related media objects (a table of relations between media objects, see 
Figure 2 and thus must teach the identity of each of the related object as 
well (otherwise the data is completely useless)); 
analyzing the metadata of the selected media objects {[col 3, lines 52 - 

54], the table of relations links the linear media data and any digitized media 

data); and, 

in the event that the selected media objects include related media objects, 
arranging the media elements associated with the selected media objects, or 
identifiers thereof, in a media article in dependence upon the type of relationship 
of the related media objects forming some or all of the selected media, or 
identifiers thereof, as determined by the metadata analysis {[col 11, lines 39 - 41] 
the table of relations is analyzed by the application continuously to find 
equivalent media data, i.e. media data that can be part of the same time 
sequence from the same or different sources and arranges media data by 
changing sources as well as adding additional pieces of media data in 
accordance to the results of the analysis). 

Sweat et al further teaches said one or more media element selection 
criteria comprise a set of template data, each of said sets of template data listing 
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a plurality of slots to be filled ([col 7, lines 1 2-1 8] palette is a template with a 
number of slots), and, for each slot, one or more associated requirements of 
media elements for filling said slot ([col 7, lines 12-18] user query sets criteria for 
filling the slot on the palette); and said one or more processors are further 
arranged in operation to provide said subset by, for each of said slots, retrieving 
one or more identifiers of media elements whose metadata accords with said one 
or more requirements for said slots ([col 7, lines 12-18] fully constructed palette 
can be saved and used). It would have been obvious to a person of ordinary skill 
in the art at the time of invention to use an object-oriented database of Sweat et 
al with the apparatus of Reber et al because it would allow for greater 
compatibility, modularity and easy of use for a user. 

15. In regard to claim 28, Reber et al. teaches an apparatus according to 
claim 27 in which said relationship data indicates a causal type of relationship 
between what is represented by one media element and what is represented by 
the related media element (a table of relations between media objects, see 
Figure 2 and thus must teach the identity of each of the related object as well 
(otherwise the data is completely useless)). 

16. In regard to claim 29, Reber et al. teaches an apparatus according to 
claim 27 wherein said one or more processors are further operable to provide a 
user with an interface enabling the user to enter said relationship data {Figure 1). 

17. In regard to claim 30, Reber et al. teaches an apparatus according to 
claim 27 wherein: said metadata is stored in a database {Figure 2; data is stored 
in a table in memory); and said one or more processors are further operable to 
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query said database to obtain identifiers of media elements whose associated 
metadata meets one or more conditions specified in said query {[col 11, lines 39 
-41] the table of relations is analyzed by the application continuously to find 
equivalent media data, i.e. media data that can be part of the same time 
sequence from the same or different sources and arranges media data by 
changing sources as well as adding additional pieces of media data in 
accordance to the results of the analysis). 

18. In regard to claim 31 , Reber et al teaches the invention as substantially 
claimed. Reber et al does not explicitly teach the use of an object-oriented 
database. However, Sweat et al teaches said database comprises an object- 
oriented database and metadata for each set of stored media data is stored as 
an object in said object-oriented database ([col 3, lines 54-57]). It would have 
been obvious to a person of ordinary skill in the art at the time of invention to use 
an object-oriented database of Sweat et al with the apparatus of Reber et al 
because it would allow for greater compatibility, modularity and easy of use for a 
user. 

19. In regard to claim 32, Reber et al. teaches an apparatus according to 
claim 27 further comprising a content store storing a plurality of media elements, 
said metadata for each media element including a pointer to the location of said 
media element in said content store {[col 11, lines 39 - 41] the table of relations 
is analyzed by the application continuously to find equivalent media data, i.e. 
media data that can be part of the same time sequence from the same or 
different sources and arranges media data by changing sources as well as 
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adding additional pieces of media data in accordance to the results of the 
analysis).. 

20. In regard to claim 33, Sweat et al further teaches said one or more media 
element selection criteria comprise a set of template data, each of said sets of 
template data listing a plurality of slots to be filled {[col 7, lines 1 2-1 8] palette is a 
template with a number of slots), and, for each slot, one or more associated 
requirements of media elements for filling said slot ([col 7, lines 12-18] user query 
sets criteria for filling the slot on the palette); and said one or more processors 
are further arranged in operation to provide said subset by, for each of said slots, 
retrieving one or more identifiers of media elements whose metadata accords 
with said one or more requirements for said slots ([col 7, lines 12-18] fully 
constructed palette can be saved and used). It would have been obvious to a 
person of ordinary skill in the art at the time of invention to use an object-oriented 
database of Sweat et al with the apparatus of Reber et al because it would allow 
for greater compatibility, modularity and easy of use for a user. 
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Conclusion 

21 . THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of 
time policy as set forth in 37 CFR 1 .1 36(a). 

A shortened statutory period for reply to this final action is set to expire 
THREE MONTHS from the mailing date of this action. In the event a first reply is 
filed within TWO MONTHS of the mailing date of this final action and the advisory 
action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 CFR 1 .1 36(a) will be 
calculated from the mailing date of the advisory action. In no event, however, will 
the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Garrett Smith whose telephone number is 
(571 )270-1 764. If attempts to reach the examiner by telephone are 
unsuccessful, the examiner's supervisor, Tim T. Vo can be reached on (571) 
272-3642. The fax phone number for the organization where this application or 
proceeding is assigned is 571-273-8300. 



Application/Control Number: 10/525,381 Page 13 

Art Unit: 2168 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). If you would like assistance from a USPTO Customer Service 
Representative or access to the automated information system, call 800-786- 
9199 (IN USA OR CANADA) or 571-272-1000. 

April 19, 2010 /GS/ 

Garrett Smith 
Patent Examiner 
Art Unit 2168 

/Tim T. Vo/ 

Supervisory Patent Examiner, Art Unit 2168 



